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Abstract 

This is a study of the information evolution of complex systems 
by a geometrical consideration. We look at chaotic systems evolving 
in fractal phase space. The entropy change in time due to the fractal 
geometry is assimilated to the information growth through the scale 
refinement. Due to the incompleteness of the state number counting 
at any scale on fractal support, the incomplete normalization YliPi = 
1 is applied throughout the paper, where q is the fractal dimension 
divided by the dimension of the smooth Euclidean space in which the 
fractal structure of the phase space is embedded. It is shown that the 
information growth is nonadditive and is proportional to the trace- 
form J2iPi ~ J2iPi which can be connected to several nonadditive 
entropies. This information growth can be extremized to give power 
law distributions for these non-equilibrium systems. It can also lead 
to a nonextensive thermodynamics for heterogeneous systems which 
contain subsystems each having its own q. It is shown that, within this 
thermodynamics, the Stefan-Boltzmann law of blackbody radiation 
can be preserved. 
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1 Introduction 



The aim of this work is to study the information evolution and the ther- 
modynamics of non-equilibrium complex systems whose phase space volume 
gradually maps into fractals or multifractals at long time t — > oo[l]. 

The motivation of this work is relevant to the generalization of Shannon 
information entropy which are in general connected to dense phase space 
(T-space). One notices that the generalized entropies[2] are just posited or 
postulated as such and recover Shannon entropy as the generalization indexes 
(parameters) take special values. Some of these generalized entropies, e.g., 
Havrda-Charvat-Tsallis one [3, 4] and Renyi one [5], are believed to have some 
connections with fractal geometry of phase space and with chaotic behavior 
of non-equilibrium systems at stationary states, and have been used to de- 
velop generalized statistics whose mathematical structure mimics the formal 
system of the conventional statistical mechanics of Boltzmann-Gibbs[4, 6, 7]. 

The idea of this work is to study the information or entropy from the 
outside of the aforementioned formal systems based on the postulated infor- 
mation measures or entropies. We just look at the geometry of the phase 
space of a non-equilibrium system to calculate the information evolution and 
to see whether it has something to do with the generalized entropies. We 
suppose an ensemble of non-equilibrium systems moving in a fractal T-space, 
the volume of its initial condition gradually mapping into fractal structure. 
If one looks at the trajectory of a system of the ensemble as it runs over 
the permitted phase points, one will see that the phase volume is covered 
more and more and that a fractal emerges from the covered regions. In this 
case, as the system evolves in time, a scale refinement would be necessary 
to calculate the heterogeneously occupied volume. So the long time effect 
of the system of interest can be likened to its ensemble effect : the time 
behavior of the trajectory of a system is replaced by the iteration of the scale 
refinement from the initial phase volume of the ensemble. As a consequence, 
the information evolution in time can be estimated by the ensemble average 
of the information growth during the scale refinement, i.e., 

lim — / i(t)dt =>- lim Pi hds — p,- / Lds (1) 

v ^°° i=1 Js(i) j=1 Js(j) 



1(T) = 
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where T(T) is the average information change during the time T, i(t) is the 
information change per unity of time, Pi is the probability that the system is 
found on the element % of the phase space, U is the density of information on 
the element i of volume s(i), vt and vq are the total numbers of the elements 
of phase space accessible to the system and visited by the trajectories at time 
t = T and t = 0, respectively. According to our assumption, the vt elements 
visited by the system form a fractal structure which can be reproduced by the 
Vk elements yielded from the vq elements by certain map (scale refinement) 
of k iterations. So we can put = vt- 

Due to the incompleteness of the counting of state points or the cal- 
culation of geometrical elements at any given scale in fractal structures [8], 
the discussion will be made on the basis of the normalization of incomplete 
probability distribution [5] proposed for the complex systems having physical 
states which are accessible to the systems but inaccessible to mathematical 
treatment [7, 8, 9, 10]. 

2 Incomplete normalization 

Now we look at a fractal phase space of dimension df embedded in a smooth 
Euclidean space of dimension d. We know that any counting or calculation 
of state number must be carried out at certain scale of the phase space. In 
fractal phase space, the state number and the phase volume change from 
scale to scale. So the state counting is never complete for a given scale or 
partition of the phase space. In other words, the calculated states or phase 
volume is incomplete. Our method consists in taking this incompleteness 
into account in the probability calculation. We have assumed[7, 8, 9, 10] : 

E Pl = i, (2) 

where Vk is only the number of the states or phase elements accessible to the 
summation at the k th iteration, q is given by q = df/d, pi k = s ik /So is the 
probability that the system visit the elements % of volume Si k of the fractal 
at the k th iteration, and Sq the volume of the phase space containing the 
fractal. 

The probability defined above is different from the usual frequency or 
time definition. Here the probability p ik does not sum to one because it is 
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the ratio of non-differentiable fractal elements to an integrable and differ- 
entiable smooth space volume. So this definition allows one to carry out 
calculations of fractal or hierarchical probability distributions by using the 
usual mathematical tricks defined for smooth Euclidean space. It is analo- 
gous to the proposition in [1] to define probability p-i for the system to visit 
the phase element % by the ratio of the number of trajectories (oc volume s$) 
on the element % to the total number of trajectories (oc total volume So) in 
the initial conditions uniformly distributed in a Euclidean space. 

Eq.(2) has been called incomplete normalization [7, 9]. Its incompleteness 
lies in the fact that the sum over all the Vk elements at the k th iteration 
does not mean the sum over all the possible states of the system under 
consideration. In other words, the volume Si k does not represent the real 
number of states or trajectories on the element %k which, as expected for 
any fractal and hierarchical structure, evolves with iteration or phase space 
partition. 

3 Information growth due to fractal geome- 
try 

The evolution of the accessible phase volume of a system during the scale 
refinement is calculated as follows. The extra state points 

ife+i=i 

acquired from certain element ik at the iterate of (k + l) th order are just the 
number of unaccessible states at k th order with respect to (k + l) th order, 
where n ik is the number of elements Sj k+1 replacing, at (k + l) th iterate, the 
element Si k and jk+i is the index of these elements. 

What is the information change in that case? At the iterate of order k, 
the information content on Sj, is given by Ik(i) = L. I(p)ds where I(p) is 

l k 

the information density as a function of the state density p supposed scale in- 
variant. This scale invariance, according to our assumption in Eq.(l), implies 
constant p in time. So at k+ 1 order, we have Ik+i(i) = £ 1 -.'? l =i L I(p)ds. 

Jk + l Jk + 1 

Remember that the definition of the probability pi k oc Si k implies constant 
p over all the occupied elements of the phase space. In the case where ev- 
ery phase point is visited with equal probability, constant p means constant 
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state density over these elements. This is a natural result of the uniformly 
distributed states in the initial condition phase volume So if we consider the 
time and scale invariance of p mentioned above. 

Then the information growth on certain phase element i k from k th to 
{k + l) th iteration reads 

A/ fc (i) = I k+1 (i) - h{i) = ! I(p)ds = I(p)A lk (4) 
The relative information growth is then given by 

R k ^ k+1) {i k ) = M k {i)/I k {i) = Y,—- 1 - (5) 

j k+1 =l Pik 

The expectation of this relative information growth over all the fractal can 
be calculated by using the unnormalized expectation as follows 

Vk V k + 1 V k 

i4->(fc+l) = Pi k Rk^(k+l)(ik) = Pik+i ~J2Pik- ( 6 ) 

i k =l **+i=l *fc=l 

The total relative information growth from th to certain order, say, A, of the 
iteration is then given by 

A-l _ v x v x 

Rx = R ^x = J2 R k^(k+i) = Y.Pi*- 1= J2 (Ph ~ Pi) ( 7 ) 

k=0 *A=1 *A=1 

since Y%%=i Pi = So/ S = 1. We would like to mention that these calculations 
can also be formally carried out under the formalism of complete probability 
distribution if we suppose pi = pf. In this case, R k to the k th iteration reads 
Rk = Z)ij=i Pi^ 9 ~ 1 with X)it=i pi k — 1. pi k can be of course regarded as a 
probability distribution on a complete ensemble of v k states. 

Following are some properties of R\ (the index A will be dropped from 
now on, i.e. R = R\) : 

1. Nonadditivity : for a fractal of dimension df composed of two sub- 
fractals A and B of dimension df A and df B satisfying product joint 
probability Pi A % B = Pi A Pi B , it is easy to show the following nonadditivity 

R(A + B) = R(A) + R(B) + R{A)R(B). (8) 
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2. R is positive and concave for q > 1, and negative and convex for q < 1. 
If g = 1 or d = df, the fractal structure does not exist any more, so 
R = 0. 

3. i? is an information growth attributed to the dimension difference 
(df — d) and calculated from the actual probability distribution p^. 
An interesting feature of R is that the ratio leads to the Havrda- 

Charvat-Tsallis entropy S = ^ iPl q J^ iPi [3, 4]. The asymptote of this 
ratio for df — > d leads to Gibbs-Shannon entropy S = —J2iPi^ n Pi- 
other nonadditive entropies in the long list given by [2] can be ob- 
tained in similar way For example, the ratio ln ^^ gives Renyi entropy 

gr _ ln (a = 1/q) for complete distribution [5] or S r = ln ^ P ' for 

incomplete distribution[ll], and the ratio - — J d gives Arimoto en- 

tropy g^ ^ff'" 1 ^]. 

4. It is straightforward to prove from the connections of R with differ- 
ent entropies that the maximum of these entropies is (mathematically) 
equivalent to the extremization of the information growth R. So it is 
expected that the i?-extremum can be used to obtain probability dis- 
tributions similar to those obtained from maximum entropy. Here are 
some examples of the power law probability distributions yielded by 
the extremization of R (q ^ 1) for some chaotic systems. 

The extremization of R = Jq p(x)dx — 1 (0 < x < 1 is the random 
variable of the continued fraction ma^[13] x n+ i = l/x n — \ l/x n ~\) under 
the constraints associated with the normalization Jq p q (x)dx = 1 and 
the unnormalized expectation x = Jq 1 p(x)xdx gives 

P{X) = l (l-^)i/d- g ) 0) 

where q — 1/2 for the continued fraction map, 7 = — 1 is the Lagrange 
multiplier associated with x and the constant Z = v4n2 is determined 
by the incomplete normalization. The Zipf- Mandelbrot's law p(x) = 
(1-73;)" can ^ e derived with 1/q = 1 + 1/ a (A is the normalization 
constant). The distribution of the Ulam maps p(x) = ^73—2)172 ( — 1 < 
x < 1) can be obtained with q = 1/3 if x 2 is used as a constraint. 
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It should be emphasized that, although the same kind of distribution 
functions as mentioned above can also be derived from the maximization 
of Tsallis entropy S or of Renyi one S r under the same constraints, the 
extremization of R are physically different from the entropy maximisation 
derived from the second law of thermodynamics. R is intrinsically connected 
with non-equilibrium evolving system. So extremizing R implies looking for 
the probability distribution that, among many other possible ones, maximizes 
the information change of the system in evolution. For this kind of systems, 
it is impossible to talk about maximizing entropy in the sense of the second 
law because entropy is still in constant variation. 

On the other hand, if the entropy of the system of interest is defined such 
that the i?-extremization is equivalent to the maximization of the entropy, 
then the thermostatistics based on the maximum entropy principle may be 
discussed in connection with the i?-extremization. This is what we are doing 
in the following for the statistical thermodynamics derived from maximizing 
Tsallis entropy. 



4 A thermodynamics of non-equilibrium sys- 
tems with different g's 

An important question about the nonextensive statistical thermodynamics 
based on Tsallis entropy [4] concerns its validity for the systems having differ- 
ent g's for which the thermodynamics must be formulated in a more general 
way than the thermodynamics for the same g-systems[15, 16]. This for- 
mulation is crucial for nonextensive statistics because a composite system 
containing different g-systems is a general case in nature. We are showing 
here that a possible formulation can be made for systems having different 
q 7^ 1 on the basis of the nonadditivity given by Eq.(8). We suppose that the 
non-equilibrium system is at some stationary state which maximizes Tsallis 
entropy for the total system A + B. As mentioned above, this maximization 
is equivalent to the extremization of R for A + B, i.e., dR(A + B) — 0. This 
leads to 1 C ^^ + i+^b) = ® w hich means 

(U ~ l)dS(A) (gg - l)dS(B) _ 

E iPi (A) + Z iPi (B) 1 ) 

where S is the aforementioned Tsallis entropy. Now using the product joint 
probability and the relationship J2iPi = Z q ~ x + (q — 1)/3U connected with 
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the energy distribution function pj = — (q — l)(3Ei] l ^ q ^ given by the 
maximization of S, where Ei is the energy of the system at state i and 
U = Ei PiEi is the internal energy, we get (SA^ii^M + (is^M = 

which suggests following energy nonadditivity 

(gA - l)jj7(A) (gg - lgg) _ 

This relationship should be considered as the analog of the additive energy 
rule dU(A) + dU(B) = of Boltzmann-Gibbs statistical thermodynamics. 
Eq.(lO) and Eq.(ll) lead to 

P(A) = (3(B) (12) 

where (3 — |^ is the inverse temperature. 

For the definition of pressure, as discussed in [17], Eq.(lO) finally leads 
to, at stationarity, 







(u-lWiA) ( qB -l)dV(B) 
1 J EiPi(A) 1 ; EiPi(B) 



(13) 



where P = ff^ J is the pressure and V is the volume. The intensive pressure, 
i.e. P(A) = P(B), implies 

(q A -l)dV(A) (q B -l)dV(B) 

ErMA) + EiPi(B) { ' 

This volume can be interpreted as an effective volume allowing one to write 
the first law as dU = TdS — PdV in the case where the interface/surface 
effects cannot be neglected compared to the volume effect. Un example of 
this kind of systems with nonadditive effective volume is discussed in [17]. 



5 Thermodynamics of nonadditive blackbody 

Now let us suppose a nonadditive blackbody obeying the above statistical 
thermodynamics with the volume nonadditivity indicated by Eq.(14). As 
mentioned above, this case is possible when emission body is small (for ex- 
ample, the thermal emission of nanoparticles or of small optical cavity) such 
that the surface/interface effect may be important. We have seen in the 
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above paragraph that dU, dS and dV should be proportional to each other. 
This can be satisfied by U — f(T)V and S = g(T)V. In addition, we ad- 
mit the photon pressure given by P = ^ = |/(T). From the first law 
dU = TdS — PdV, we obtain 

df da 1 

V-^dT + fdV = TiV^dT + gdV) - -fdV, (15) 

which means |£ = Tj^ and |/ = Tg leading to |^ = |£. We finally get 

/(T) = cT 4 (16) 

where c is a constant. This is the Stefan-Boltzmann law. On the other hand, 
from the relationship (§^)t = (§f^)v> we obtain g = |J£ and g(T) = bT 3 
where b is a constant. Notice that the above calculation is similar to that 
in the conventional thermodynamics. This is because the thermodynamic 
functions here, though nonadditive, are nevertheless "extensive" with respect 
to the effective volume. This result contradicts what has been claimed for 
blackbody radiation on the basis of non intensive pressure [15], and is valid 
as far as the pressure is intensive. 

Following analysis shows what happens if one supposes additive volume 
V, i.e. dV(A) + dV(B) = 0. From Eq.(13), one gets 

P(i)|^| = P(B)^-^. (17) 

So the conventional pressure P = (f^) 5 becomes non intensive. If one 

still supposes P = ^7, this will lead to a deviation from the conventional 
Stefan-Boltzmann law as shown in [15]. There are two questions here to be 
noticed. 1) Is non-intensive pressure possible? 2) The relationship P = 
was established within the conventional thermodynamics for additive photon 
gas. Is it still true for nonextensive or nonadditive photon gas having non 
intensive pressure? Obviously, the final answers to these questions require 
experimental proofs (which are still missing as far as we know). 



6 Conclusion 

In summarizing, we have studied the information growth during long time 
evolution of chaotic systems having fractal phase space through the scale re- 
finement in the phase space. This information growth turns out to take the 
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trace form J2i Pi ~ Hi Pi which can be connected with several entropies gener- 
alizing Shannon one. It is shown that the power law probability distributions 
of several chaotic systems can be obtained by extremizing this information 
growth. However, this work leaves open the questions as to whether in gen- 
eral one can maximize entropy to get the probability distributions for non- 
equilibrium systems in (stationary or not) evolution and whether one should 
extremize the entropy or information change. In any case, if the information- 
entropy of the system is of Tsallis type, these two methods turn out to be 
mathematically equivalent. 

On the basis of the information growth, we discussed the thermodynam- 
ics of non-equilibrium systems in stationary state which maximizes Tsallis 
entropy. Intensive variables like temperature and pressure can be defined 
for an ensemble of systems having different q's. It is argued that Stefan- 
Boltzmann law for blackbody radiation can be preserved within this thermo- 
dynamics. We would like to emphasize that this work is carried out by using 
incomplete probability distribution and the corresponding unnormalized ex- 
pectation. We have noticed that the normalized g-expectation U = J2iPiEi 
for incomplete distribution could not be used due to the product joint prob- 
ability Pij(A + B) = pi(A)pi(B) connected with the nonadditivity given by 
Eq.(8) and Eq.(lO). In this case, the unnormalized expectation allows one 
to split the thermodynamics of the composite system into those of the sub- 
systems, a necessary condition for the establishment of zeroth law. This 
constraint on the nonextensive thermodynamics favours the use of the un- 
normalized expectations U = YliPiEi at least for the systems having different 
q's. However, if the complete probability distribution J2iPi — 1 is employed 
in the framework of the thermodynamics based on Tsallis entropy S, we have 
p^ +B (A + B) — p < - A (A)pj B (B) as generalized product joint probability de- 
rived from Eq.(8). In this case, the unnormalized expectation U = J2iPi^i or 
its normalized variation U = J^iPfEi/ J2iPl should be used in order to split 
the thermodynamics and to establish the zeroth law as discussed in [18]. 
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